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Abstract 



We study a linear recursion with random Markov-dependent coefficients. In a "regular 
variation in, regular variation out" setup we show that its stationary solution has a 
multivariate regularly varying distribution. This extends results previously established 
for i.i.d. coefficients. 
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1. Introduction and statement of results 

Let Q n be random d-vectors, M n random d x d matrices, and consider the recursion 
X„ = Q n +M w X B _i, X n eR d , neZ. (1) 



This equation has been used to model the progression of real-world systems in discrete 
time, for example, in queuing theory [l[ and financial models 0, See for instance 



£Nj ' 0, H, H, 0] and references therein for more examples. 



Let I denote the d x d identity matrix and let il„ = MqM_i • • • M_„ for n > 0. 
It is well known (see for instance |8|) that if the sequence (Q n , M n ) ne i is stationary 
and ergodic, and the following Assumption 11.11 is imposed, then for any X scries X n 
converges in distribution, as n — > oo, to the random equilibrium 

oo 

x = Qo + ]rn_ fc+1 Q_ fe , 

H ' fc=1 



which is the unique initial value making (X n ) n >o into a stationary sequence. 

For Q e R d define ||Q|| = maxi<i<d |Q(«)] and let ||M|| = sup QeRd || Q || =1 ||MQ|| 
denote the corresponding operator norm for a d x d matrix M. The following condition 
ensures the existence and the uniqueness of the stationary solution to ([1]) . The condition 
is also known to be close to necessity (see Q). 
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Assumption 1.1. 



(Al) E(\og + \\M \\) < +00 andE(log + ||Q ||) < +00, where x + := max{a;, 0} for x G K. 

(A2) The top Lyapunov exponent A = lim^^oo ^ log HM1M2 • • • M n \\ is strictly negative. 

The stationary solution X of the stochastic difference equation (fTJ) has been studied 
by many authors. Assuming the existence of a certain "critical exponent" for M ni the 
distribution tails P(X • y > t) and P(X • y < — t) for a deterministic vector y G K d 
were shown to be reg ularly varied (in fact, power tailed) in [10( (for d = 1 an alternative 



proof is given in Under different assumptions and for d = 1 only, similar results 

for the tails of X were obtained in [l^, fl3|. The multivariate recursion (TTJ) and tails of 
its stationary solution X were studied in [l4, TBI 16 1 under conditions similar to those 



of and in 17, 18 1 extending the one-dimensional setup of 12, lj|. In all the works 
mentioned above, it is assumed that (Q n ,M n )„ £ z is an i.i.d. sequence, and [I?], 18| 
suppose in addition that the sequences (Q n )«ez and (M ra ) w( =z are mutually independent. 

The goal of this paper is to extend the results of [l2|,[l3| to the case where (Q n , Mn)nei 
are induced by a Markov chain. The extension is desirable in many, especially financial, 
applications, see for instance lj|, 20[. We remark that in dimension one the results of 



applica 

Sua 



(where M n is dominant in determining the tail behavior of X) and [12|, [l3[ (where 



Q„ is dominant) were extended to a Markovian setup in [2l|, |22j and |23[, respectively. 

Let 1a denote the indicator function of the set A, that is 1a is one or zero according 
to whether the event A occurs or not. 

Definition 1.2. The coefficients (Q n ,M„)„ g z are said to be induced by a sequence of 
random variables (Z n ) ng z, each valued in a finite set T>, if there exists a sequence of 
independent random pairs (Q n ,;, Mn,i)nez,iev with Q n ,i G K d and M n ^ being d x d 
matrices, such that for a fixed i G P, (Q n ,i, M n ^) n ^.% are i.i.d and 

Qn = / ] Qn,jl{z n =j} = Qn.-Zn and M n = 2J M n ,jl{z n =j} = M n<Zn ■ (2) 
jev jev 

Notice that the randomness of the coefficients (Q n ) n ez induced by a sequence (Z n ) ne z 
is due to two factors: 

1) to the randomness of the underlying auxiliary process (Z n ) n£ z, which can be 
thought as representative of the "state of the external world," 

and, given the value of Z n , 

2) to the "intrinsic" randomness of characteristics of the system which is captured by 
the random pairs (Q n ,z„, Mn,z n )- 

The independence of Q, M : and M n j is not supposed in the above definition. Note that 
when (Z n ) n ( z2. i s a finite Markov chain, @ defines a Hidden Markov Model (HMM). See 
for instance [24j for a survey of HMM and their applications in various areas. 

We will further assume that the vectors Q n; i are multivariate regularly varying. Heavy 
tailed HMM have been considered for instance in J5[ , see also references therein. Recall 
that, for a G K, a function / : K — > R is regularly varying of index a if f(t) = t a L(t) 
for some L(t) : K — >• R such that L(Xt) ~ L(t) for all A > (that is L(t) is slowly 
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varying). Here and henceforth f(t) ~ g(t) (we will omit H — J> oo" as a rule) means 

lim t ->oo f(t)/g(t) = 1. 

Let 5 ld_1 denote the unit sphere in R d with respect to the norm || • ||. 

Definition 1.3. A random vector Q £ M. d is said to be regularly varying with index 
a > if there exist a function a : R — > R regularly varying with index 1/a and a finite 
Borel measure &q on S ld_1 such that for all t > 0, 

nP(||Q|| > to„; Q/IIQH e •) A IWOO =i-«e Q (-), as n -> oo, (3) 

where A denotes the vague convergence on S^ -1 and a n := a(n). 

We denote by lZd, a ,& the set of all d-vectors regularly varying with index a, associated 
with function a 6i/ 

Let E be a locally compact Hausdorff topological space. The vague convergence of 
measures v n — > n ^oo v for finite measures v n , n > 0, and v on E means (see for instance 
Proposition 3.12 in (26|) that lim sup,^^ v n (K) < v{K) for all compact K C E and 
liminf„_i. 0O v n (G) > i^(G) for all relatively compact open sets G C E. In this paper we 

consider vague convergence on either or Rq := [— oo, oo] d \{0}, where stands for 

the zero vector in R d . In both spaces the topology is inherited from R d (in the case of Ro 
by adding neighborhoods of infinity and removing neighborhoods of zero, see for instance 



27] for more details) and can be defined using an appropriate metric making both into 

a locally compact Polish (complete separable metric) space. A set K C Rq is relatively 

compact if its closure does not include 0, which makes the space R especially useful 
when convergence of regularly varying distributions is considered. 

The definition Q is norm-independent and turns out to be equivalent to the following 
condition (see for instance (2?],[28[ or [29j|): 

There is a Radon measure v on Rq such that nP(a~ 1 Q £ •) A^oo v{-). The 
measure v is referred to as the measure of regular variation associated with (Q, a). 

The regular variation of a random vector Q £ R d implies that its one-dimensional projec- 
tions have regularly varying tails of a similar structure. More precisely, if Q is regularly 
varying then for any x £ R d , 

t-yoo t L(tj 

for a slowly varying function L and some w(x) : R rf — > R which is not identically zero. 
The property (U]) was used as a definition of regular variation in 10], and it turns out to 
be equivalent to Q for all non-integer a as well as for odd integers provided that Q has 
non- negative components with a positive probability 30] . The question whether (j4]) and 
§3§ are equivalent for even integers a in higher dimensions remains open. 

In this paper we impose the following conditions on the coefficients (Q n , M n ) ne z. 

Assumption 1.4. Let (Z n ) ne % be an irreducible Markov chain with transition matrix 
H and stationary distribution tt defined on a finite state space V. Suppose that the co- 
efficients {Qn, Mn)nei, in (0 (ire induced by the stationary sequence (Z n )„gz, Assump- 
tion \l.l\ is satisfied, and, in addition, there exist a constant a > and a regularly varying 
function a : R — >• R such that 
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(A3) For each i£"D, Qo^ G 7&d,a,a with an associated measure of regular variation fj,i. 
(A4) A(/3) := limsup ?woo i log-B(||II_ n ||^) < for some (3 > a. In particular, 

There exists m > such that #(||n_ m || Q ) < 1 and E(\\n^ m \f) < 1. (5) 



The following theorem extends results of [12J, 113J, [171, |23j to multivariate recursions of 
the form (TTJ) with Markov-dependent coefficients. 

Theorem 1.5. Let Assumptions \l-4\ hold. Then X G lZd, a ,& with measure of regular 
variation /ix(') = X)fc=-oo ^(/fz °n^j L 1 (')) i where /ioII _1 (-) stands for /it({x : ITx G ■}). 

The theorem is an instance of the phenomenon "regular variation in, regular variation 
out" for the model |T]). We remark that the mechanisms leading to regularly varying tails 



of X are quite different in [13j, ll2j versus [lCj, 111] . In the former case, Kesten's "critical 
exponent" is not available, and therefore more explicit assumptions about distribution 
of Q„ are made. Then Q„ dominates and creates cumulative effects, namely X turns 
out to be regularly varying as a sum of regularly varying terms II„ + iQ n . The setup of 
Assumption If .41 is particularly appealing because a similar "cumulative effect" enables 
one to gain insight into the structure and fine properties of the sequence (X„)„ e N, in 
particular into the asymptotic behavior of both the partial sums as well as multivariate 



extremes of (X„)„ e m, see for instance @, Hi, 32, 33l.l34l.l3" 

The proof of Theorem 11.51 is included in Section [2l with the exception of the main 
technical lemma (Lemma 12. II below) whose proof is deferred to the Appendix. The proof 
combines ideas developed in 12 1, |17| . and [23l |. We notice that Grey conjectured in 



[l2l ] that using his method it may be possible to extend the results of [13] and rid of 
the assumption that (Q„) n ez and (M„)„ e z are independent. We accomplish here the 
program suggested by Grey, and in fact extend it further to coefficients induced by a 
finite-state irreducible Markov chains. 

2. Proof of Theorem [TH 

The following result extends Lemma 2 in pjj and the relation (2.4) in 17]. Notice, 



that in contrast to 17] we do not assume that Q and M are independent. 
Lemma 2.1. Let Y, Q be random d-vectors and II be a random d x d matrix such that 
(i) Q is independent of the pair (Y,LT) 

(ii) For some constant a > and regularly varying a : R — > R, Y and Q belong to 
T^-d,a,a. with associated measures of regular variation measures v and /i, respectively. 

(Hi) _E(||n||' 3 ) < oo for some (3 > a. 

Then, Y + IIQ G lZd >a ,a. with associated measure of regular variation ^(-) + i?(/^oII _1 (- )). 

The proof of Lemma l2.1l is deferred to the Appendix. The next lemma, which gener- 
alizes Proposition 2.1 of [23j, is the key element of our proof of Theorem 11.51 
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Lemma 2.2. Let Assumption \l .4\ hold. Fix an integer k < — 1 and let Y^+i £ Mr be a 
random vector such that Y k +i € cr(Z n , Q„, M n : n > k + 1). Let Y& = Yfc + i + Tl k+ iQ k 
and write Y fe = J2iev Y kA{z k =i}- 

Then, each vector Y k ^ belongs to TZd, a .& with associated measure of regular variation 
Vk.i ■= E(v k+ i tZk+1 {-)l{z k =i}) + E(fi. L ~Rkli(-)I{Z k =i}) , and hence Y k G Hd, a ,a. with 
associated measure of regular variation E(yk+i,z k+1 (-)) + E{p, z o n / 7j L 1 (-)). 

Proo/. Since P((Q fc , IL, +1 , Y k+1 ) e -|Z fc+1 = i, Z fe = j) = P({Q ld ,U k+hi ,Y k+hi ) e •)> 
using Lemma 12.11 we obtain for Borel subsets AcIq, 

P(a" x Y M £A)=^ P(Y fc+1 + n fe+1 Q fe 6 a„A|Z fe+1 = j, Z k = i)nH(i,j) 

= ^2P(Y k+ i,j + TL k +i,jQk,i e a n A)TTiH{i,j). 
jev 

= £[, i+ i J (i)+£(ii,on t ; iJ (4))]i,jj(i,j) 

= B(i< fc+ i iZlH . 1 (i4)i {Zfc=i} ) + £;(/i i on^ 1 (A)i {Zfc=i} ). 

The proof of the lemma is completed. □ 

We are now in position to complete the proof of Theorem 11.51 First we introduce 
some notations. Throughout the rest of the paper: 

For a constant S > and a set K (either in S^ 1 or K. ), let K s denote the closed 
^-neighborhood of K, that is K s = {x : 3 y G_ftT s.t. ||x - y|| < 5}. For x e M rf /{0}, let 
x denote its direction x/|jx||. For a set G, let G denote its closure n<5>o G 5 ■ 

The final step in the proof is similar to the corresponding argument in [17j ]. and is 



reproduced here for the sake of completeness. It follows from Lemma [2.21 that, for any 
LeN and Borel A C Mq, 

o o 

^L nP { E n fe+iQfe e a nA) = E(^z k »n^(i)), (6) 

k=-L k=-L 

while 0, Theorem 1.4] yields with the help of ([5]) that for any constant 8 > 0, 

-L-l 

lim limsup nP( V ||n fc+1 || • |[Q fe || > 6a n ) = 0. (7) 

A:— — oo 

For a compact set K CM. , we have 

p( E n fe+1 Q fc e a n /v) < p( E Q fe n fe+1 e a„x 5 ) +p( ||n fc+1 Q fe || > <k„ 

Hence, limsup^ nP(£ £L-» II fc+1 Q fe 6 < EL-l^K °n^(^)) in 
virtue of © and Q. Letting then S — s> 0, we obtain 

o o 

hmsupnP^ 1 ^ n fc+1 Q fe 6A')< £ oH^fK)). (8) 

fe— — oo re— — oo 



Let G C M.Q be relatively compact and open. Consider open relatively compact sets 
Gfe C Mq, k G N, such that Gk C Gk C Gk+i C G. For any to, L, there is e > such that 

f jr IL k+1 Q fc G a„G m ) |j{ E ILt+iQft <ea„}cf E IL, +1 Q fc e a„G|. 

l fc=-L J 1 fc=-oo J L k=-oo ' 

Therefore, with J-q :— a{M n , Z n : n < 0), we have for any G m , 



liminfnPfa- 1 V IR, +1 Q fe G C] = liminf nPLpffl- 1 V II fe+1 Q fe G G|JF 

k— — oo fc— — oo 

-L-l 

^(a,; 1 ^ n* + iQ fe eG m |j- )^(|| J] n*+iQ fe | < £a n |jb 

k— — L k— — oo 

-L-l 

liminf nP^a,; 1 E Ilfc+iQfe G G OT J" )-P(| X] n fc+iQfc < a n e 7" 



lim inf P 

n— >co 



> E 



k=-L 



k— — c 



where for the last inequality we used Fatou's lemma. Hence, ([6]) yields the lower bound 
l ^ i ^ nP ( a n 1 Y,l=-oo~ n -k+iQk e G) > EL-l £ K ° n fe+i( G ™))- Letting m ^ oo 
and then L -> oo, liminf nP(a- 1 E° = -oo Hfc+iQfc G g) > EL-oo^K oH^fG)). 

n— >oo V / 

This bound along with ([5]) yield the claim of the theorem provided that we have shown 

that /ix(-) = E^ Zk o n j ^ 1 (-)) is a Radon measure on Rq, that is (see for instance 

Remark 3.3 in [l8j]) fiy^{K) < oo for any compact set K G Mq. Toward this end notice 
that since €k '■= mfxeif ll x ll > an d m virtue of (A4) of Assumption II. 4[ 

o o 
Mx(P)< E E [E^ oU kli( K )]= E E[Y,^{{x:Il k+1 xeK}) 

^ E E[Y / M^--M>^\\n k+1 \\- 1 })] = E i^r^(iin, + iir)<oo, 

fc— — oo 2EZ> fc— — oo 

completing the proof of the theorem. □ 

Appendix A. Proof of Lemma 12.11 

We need to show that for any compact set K C S , 
limsupnP(||Y + nQ|| > ta n , Y + IIQ G P) < r Q [6 Y (if) + P(6 Q o n -1 (if ))] (A.l) 

n— >oo 

while for any open set G C S^ 1 , 
liminfnP(]]Y + nQI] > ta n ,Y + UQ e G) > t~ a [(3y(G) + E(&q o n _1 (G ))1 (A.2) 

n— ^oo 

To this end, we will use a decomposition resembling the one exploited in [12 . Lemma 2] 
and 23], Proposition 2.1]. Namely, we fix e > and write for any Borel set A C S^ -1 , 



nP(\\Y + nQ|| > ta n , Y + IIQ e A) = J t (1 ](n) - J t (2 ](n) + J t (3 ](n) + J^(n), where 

J t (1 j(n) = nP(||Y|| >t(l + £ )a„,Y + nQ6 A), 

J t (2 ](n) = nP(|| Y|| > (1 + e)ta n , \\Y + IIQ|| < ta n ,Y + IIQ e A) 

4%{n) = nP((l - e)ta n < \\Y\\ < (1 + e)ta n , \\Y + IIQ|| > ta n , Y + IIQ e A) 

J t (4 ](n) = nP(|| Y|| < (1 - e)ta„, || Y + nQ|| > ta n , Y + ILQeA). 

Fix a constant 5 £ (0,1) and let K C be an arbitrary compact set. Then J^(n) < 
nP(\\Y\\ > t{l+e)a n ,Y e K s ) + nP(||Y|| > t(l + s)a n , \\Y - Y + UQ\\ > S). It is not 
hard to check that for any constant 7 > and vectors xjelj, 

||y - > 7 implies ||x|| > jM. (A.3) 

ThusnP(||Y|| >i(l+e)a n ,||Y-Y + IIQ|| > 6) < nP(\\Y\\ > ta n , ||II|| ||Q|| > ^) < 

g-g 

nP{\\Y\\ > ia„)p(||Q|| > — ) + nP(||II|| > a^). Since P(||n|| > a n 2 " ) < 
E(\\Uf), we have limsup nP(||Y|| > t(l+e)a n , ||Y- Y + IIQ|| > S) = 0. Thus 

limsup J\%{n) < lim limsup nP(||Y|| > t(l + e)a n ,Y e K s ) =t- a & Y {K). (A.4) 

n— >oo ' (5—7-0 n — >oo 

Since J t ^(n) < nP(||II|| > taT^) +nP(||Y|| > (1 + e)ia„)P(||Q|| > etaT^), we have 

limsup J^lin) = 0. (A.5) 

n— >oo ' 

Next, jf^(n) < nP((l-s)ta n < \\Y\\ < (l+e)ta n ) ~ t~ a [(1 -e)" a - (1 +e)~ a ] . Hence 

lim lim sup J { t %(n) = 0. (A.6) 

Define g n (x,A) = raP(||Y + IIQ|| > to„,Y + nQ e K\Y = x, n = A) . Fix constants 
p > and 77 > 0, and let J t (4 ^(n) = (n) + J t ( ^ 2) (n) + J t ( ^ 3) (n), where 

• / t 4 K ) ( n ) = ^(ff( Y J n ) I {||Y||<(l-£)ta„}I{||n||>p}) 
J t,X 2) ( n ) = ^(ff( Y ; n ) I {||Y||<(l- e )ta„}I{||n||<p}I{||Y||>^}) 

J t,1f 3) ( n ) = ^(fi'CY, n)I-[||Y||<(i- i£ )t« r! .}I{||n||< /3 }I-[||Y||<77>) - 
The first two terms tend to zero as r] and p go to infinity. More precisely, 

lim sup J$\n) < limsups(nP(||n||-||Q||>eta„|n)I { || n || >p} ) 

= (et)- a E(\\Tl\\ a I {m>p} ) -►,_>«, 0, (A.7) 
limsup J^iPin) < limsup £(rcP(||n|| • ||Q|| > eta n |n)I { ||n||<p}I{|| Y ||>^}) 

n— >-oo n— >oo 

< p a (ei)" a ^(l|Y|| > r?) "►„-«, 0. (A.8) 
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To show the asymptotic of J t ^ (n) as n goes to infinity write, 

J^i\n) < nP( V + ||nQ|| > to„,nQ £ 

+ nP(Y + ITQ - TlQII > 6, ||nQ|| > eia„, ||Y|| < 77). (A.9) 

Applying the multivariate Breiman's lemma (see for instance [36l Proposition 5.1]) to the 
first term in the right-hand side of the last inequality and (|A.3[) to the second, we obtain 
limsup„^ 00 J^i\n) < t- a E(& Q o II- 1 {K)). Thus (IA~TT) is implied by (jA~4jl -(T01). 

It remains to show that (|A.2I) holds for any open set G C S 1 . According to (IA.5I) . 
limsupn^QQ Jj < limsup,^^ = 0. Let Gj, C S"* -1 , k g N be open sets such 

that G fe C G fc C G fc+ i C G Let 7fc = ± inf{||x - y|| : x g G fe ,y £ G c }. Then, J^(n) > 
raP(||Y|| > t(l + e)a n , Y e G fc ) -nP(||Y|| > t(l + e)a n , ||Y — Y + LTQ|| > 7 fe)- B y 
Hminf jg(n) > lim e ^ liminf™ nP(||Y|| > t(l + e)a n ,Y g G fc ) = ^ Q 6 Y (G fe ). 

Letting fc^oowe obtain liminf jili(n) > t~ a &yr(G). To conclude, observe that 

n— ^00 ' 

J t (4 G 3) (n) > nP(||nQ||-j 7 >ia n ,nQeG?fe)-nP(p||Q||-7 7 >ta n ;||Q|| < 77) 
- nP(||YTTTQ -TlQH > 7 fe, ||nQ|| > £ta„, ||Y|| < rj). 

By pOI) , liminf jffiin) > t- a E(6 Q o n -1 (G fc )). Letting jfe ->■ 00 establishes (TOT) , 
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